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ABSTRACT 



This thesis is an accuracy study of three empirical 
series system lower confidence limit procedures. Computer 
simulations were used to compare the accuracy of the pro- 
cedures using the same set of data v/ith 500 replications 
for each case. Modifications were then made to improve the 
accuracy of the Log-Gamma method. 

The systems simulated had reliabilities ranging from ,6 
to .95. They were composed of four, fifteen, or forty com- 
ponents, and had component sample sizes of ten, twenty, or 
fifty. 

The Lieberman-Ross method was accurate but had high 
variance. The Log-Gamma method was conservative with small 
sample sizes, but became more accurate with increased test- 
ing. Randomization of the Log-Gamma method was the most 
successful of the modifications attempted. 
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I. INTRODUCTION 



There exist many lower confidence limit procedures for 
series system reliability which are based on component data. 
All of them are approximate in one way or another for real- 
istic testing situations. Two such procedures are the 
Lieberman-Ross (LR) procedure and the Log-Gamma (LG) proce- 
dure. The LR lower confidence limit (LCL) is based on 
operating time data and assumes time to failure is expo- 
nentially distributed. The LG LCL is based on attributes 
data and thus is non-parametric, A modification of the LG 
procedure, called the Continuous Log-Gamma (CLG) procedure, 
is based on time data and assumes an exponential failure 
distribution. 

In this thesis the accuracy of the LR, LG, and CLG pro- 
cedures are compared when data is generated from the expo- 
nential distribution for serial systems with four, fifteen, 
and forty components. Sample sizes are generated in a 
manner which is somewhat representative of data accumulated 
from missile flight tests. 

The accuracy analysis was extended to the case where 
all components were assumed to have a Weibull distribution 
with increasing and decreasing failure rates. 

In all cases, the LR and LG procedures were slightly 
modified from their more common forms in order to accommodate 
zero failures on all components. 
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Since the component test data was generated using the 
exponential assumption, the LR method enjoyed an advantage 
over the LG method in that continuous LCL procedures are 
exact while discrete LCL procedures are not. All discrete 
lOO(l-a)^ LCL*s, Rg ^0^ system reliability R^ have 

the property that 

^t^S.L(a) - ^s^ > 1 - a 

For some values of R , this probability is 100^, Thus dis- 

o 

Crete LCL's will usually be lower in value than a continu- 
ous LCL using the same set of data. Discrete LCL's have 
the advantage, however, of remaining the same regardless 
of the underlying distribution. Consequently, they are 
not susceptible to inaccuracies due to a mistaken assump- 
tion about the probability distribution of the operating 
component time data as are continuous procedures. That is, 
^S,L(a) discrete 

^t^S,L(a) - >1-0 

regardless of the probability distribution of the component 

A* 

time data, whereas if Rg is continuous 

^[%,L(a) - ^s^ = 1 - a 

provided the required assumption made about the probability 
distribution of the component failure data is correct. 

Even if the assumed continuous distribution is not correct. 
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however, s'till "be reasonably accurate, depend- 

ing upon the true component failure distribution. Of course 
these distributions are never known. 

Finally, continuous LCL's required more refined data 
than discrete LCL’s, Discrete LCL procedures can be used 
if continuous time data is available but continuous LCL 
procedures cannot be employed with only attributes data. 
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II. DESCRIPTION OF THE METHODS 



A, THE LOG -GAMMA METHOD 

The following development is a summary of that given 
in Ref, 1, The Log-Gamma (LG) method requires only attri- 
butes data, and assumes nothing about the failure distribu- 
tion. It is designed for independent series systems, does 
not require equal component sample sizes, and is approxi- 
mate. A modification of the LG method for systems composed 
of a mixture of series and parallel-connected components 
was explored by Ref. 2. 

Suppose a system consists of K components in series, 
and that N^ copies of component i are put on test and oper- 
ated until failure or completion of mission, whichever 
occurs first. Denote as the number of components of 
type i that did not complete the mission. Then the maximimi 
likelihood estimate for system reliability is 

A K ^ 

Rg= ir R. (2.1) 

® i=l ^ 

^i"^i .X 

where R. « (2.2) 

1 

In the LG proced\ire the method of moments is used to 

A 

fit the random variable -lnR_ with the two -parameter gamma 
distribution. The gamma is then transformed into a chi 
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square distribution, about which probability statements 
are made and a lower confidence limit (LCL) obtained. 
That is, define 



K 



K 



S = -lnR„ = -In IT R. = - E ln(l-Q.) 



li 1 



i=l 



i=l 



K 



K 



« 2 (Q. + iQf ) = E T. 
i=l ^ ^ i=l ^ 



An unbiased estimator for is 

A2 

A A Qf 

Ti=AiQi-. Bi-^ 



(2.3) 

(See Appendix A) 

(2.4) 



(2.5) 



2N. - 3 

where A. = -^iTTT 



( 2 . 6 ) 



^i 

®i ^ N, - 1 



(2.7) 



and 



- ^i 
^i ^ 



i = 1 , K 



(See Appendix B) 



That T^ is unbiased is important, because 

A K , 

S = E T. 
i=l ^ 



( 2 . 8 ) 



is used as an estimator for S, thereby accvimulating any 

A 

bias present in the T^. An approximate value for the vari- 



ance of S is 



K 



Var(S) = E Var(T, ) 
i=l ^ 



K T. 

« E 
i=l ^i 



(2.9) 
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Appendix C derives the actual variance of and shows 
equation (2,9) is an excellent approximation for Var(S), 

A 

Next, fit S with a gamma distribution. The probability 

A 

distribution of S is then given by the density function 



fA(xjr, e) — Exp(-x/e) 

^ r(r)e’^ 



X > 0 , r> 0 
6 > 0 



( 2 , 10 ) 



It follows that 

E(S) = re (2,11) 

Var(S) = re^ (2,12) 

A 

Since S is unbiased, 

E(S) = S 

K 

= I T, (2.13) 

i=l ^ 

Solving eq\:iations (2,9)» (2.11), (2.12), and (2,13) 
simultaneously gives the shape parameter 



r 





'K T. 
i=l ^i 



and the scale parameter 



0 = 




Thus, r can be estimated by 



A 

r 





A 



T. 



1 



N 



i 



(2.14) 



(2.15) 



( 2 . 16 ) 
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A 

Since k is distributed gamma (r,6), is distributed • 



Then 

= P(2rl>re 

A 

Since S is unbiased 
E(S) = S 
= re 
= 

Equation (2.17) becomes 

f2 



(2.17) 



(2*.18) 



l-a = P(2rS>-lnR3.;Ci.^^2^) 



= P(Ex] 



A 

-2rS 



><K) 



[lU.Zr 

Therefore, the LG lOO(l-a)^ LCL for system reliability R 
is 



(2.19) 



‘s,L(a) = 



-2rS 



XU 



(2.20) 



2r, 



To preclude usage of non-integer degrees of freedom, the 
approximation 

Tod! 

( 2 . 21 ) 



[2^] 



2i-a,[2r] 

is used in equation (2.20), where [2r] denotes the smallest 
integer greater than or equal to 2r. Approximation (2.21) 
was shown to have little effect on the LG procedure accur- 
acy [Ref. 2, p. 13 ]. However, it may produce monotonicity 
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problems under certain circumstances (discussed in Chapter 
V), Thus, the lOO(l-a)?^ LCL becomes 



and was the LG LCL initially simulated by this study (Chap- 
ter IV). 



B. THE CONTINUOUS LOG-GAMMA METHOD 

The Continuous Log-Gamma (CLG) method is developed in 
detail by Ref, 3» pages C-1 through C-20 (as the "Classi- 
cal" method). It differs from the LG method only in that 
it requires component time data and assumes exponential 
failures. 

The derivation of the CLG procedure is analogous to 
that of the LG procedure, and is outlined as follows. 
Define 

Z H -InRg 



K 

= -InfT Rj 

i=l ^ 



(2.23) 



Using time data and assuming exponentiality, can be esti- 
mated by 

where Tsum^ is the acctimulated operating time of the ith 
component. Then Z is estimated by 



A 

Z 



K 

L 

i=l 



Tsum^ 



(2.24) 
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The method of moments gamma fit to Z uses 



A K F. 
E(Z) = L - ■ 



Tsum^ 

A k/ F. 
E(Z) = LX 



(2.25) 



( 2 . 26 ) 



(2.27) 

and Var(Z) = LX^ (2.28) 

where L is the shape parameter and X is the scale parameter. 
The resultant CLG 100(1 -a )?5 LCL is 



^S,L(a) " a) 

M-a,2L 



(2.29) 



with 




Tsum^ 



K 

E 



F. 

1 



N. 



^_^iTsum^ / ■ ij 



(2.30) 



To preclude non-integer degrees of freedom 
^S,L(a) ^ 



- [zlJz 



\Xl-a, [2 l] 

where [2 l| is the smallest integer greater than or equal 



(2.31) 



A 

to 2L. 



C. THE LIEBERMAN-ROSS METHOD 
1 . The Original Procedure 

The Lieberman-Ross (LR) method was designed as an 
exact lower confidence limit (LCL) procedure for independ- 
ent series systems (see Ref. 4), It requires component 
times between successive failbres from an assiimed exponen- 
tial failure distribution, and does not require equal com- 
ponent sample sizes. 
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The test plan may be described as follows. Suppose 



copies of each component type i are available for testing. 
Place a copy of the ith component on test, and replace it 
when it fails. Continue testing with replacement until all 
available copies of one component are exhausted (this proce- 
dure need not be conducted simultaneously for all component 
types). For the ith component, denote the time to the first 
failure as between the first and second failure as T£ 2 * 

and so forth. In general, the time between the jth and 
(j-l)th failiore on the ith component is T. ., i = l,,,,,,K 



also describes the LR procediure for Type II censoring at 
the rth failure of R items on simultaneous test. Reference 
3* P« C-32, illustrates the procedure using component times 
between successive failures and the observed success time 
of the last copy of each type tested. 




where the T. • are in mission units. Reference 4, p, 84o, 
<1 J 



The LR LCL is computed as follows. Define 




(2,32) 



Let I^ be the greatest index such that 




i = 1 



K 



(2,33) 



Also define K 




(2,34) 
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The variable I is the total number of failures in all com- 
ponents up to and including U (see Figure 1), Then the LR 
100(l-a)?5 LCL for system reliability R is given by 



^S.L(a) 



72 

= Exp( “ ' ) 



(2.35) 



Figure 1 

Depiction of Lieberman-Ross Parameters 
U=35 and 1=6, when K=2, and N2=3 
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To implement the LR procedure, the component data 
order must be specified. If only a set of component data 
were available, then a different procedure would have to be 
used. Note that the opposite chi square tail is used from 
that of the LG and CLG methods, 

2, The Modified Lieberman-Ross Method 

The original procedure utilizes accumulated compo- 
nent times between failures. The Modified Lieberman-Ross 
procedure (MLR), uses instead component times to one mission 
unit or failure, whichever occiirs first. The MLR method is 
thereby more readily applied than the LR method to actual 
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system test data, especially when testing is destructive 
(for example, a missile firing). The MLR method also can 
be used when no failures occur, whereas the LR method could 
not (see Appendix D). 

The MLR procedure is 

a. Suppose copies of the ith component are avail- 
able for testing. Define T. . as for the LR procedure, ex- 

^ J 

cept all times past one mission unit are truncated to one. 
Next, define 



* 



T 



il " 



11 

Z 

0=1 




where is the index of 
the first component time 
less than one mission 
unit for the ith component 
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Z 

0=ii+l 




where i£ is the index of 
the second component time 
less than one mission unit 
for the ith component 



T 




iPi 



where ip^^ is the index of 
the last ■‘‘component time 
less than one mission unit 
for the ith component 



Then obtain 



( 2 . 37 ) 



( 2 . 38 ) 






i = 1 



.K 



( 2 . 39 ) 



b. Compute the minimum accumulated times between 



successive failures in any component type. 

K 



U = 



min m* 
Ki<K n 



min 






Ll<i<K "1 



if L F > 0 
i=l ^ 



K 

if Z F. = 0 
i=l 



(2.40) 



(see Appendix D) 
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The variable is now defined in terms of the T^. 






the greatest index such that 



li * 

I T. . < U 
0=1 



if F^>0 



if = 0 



Then 



I = max ^ 1 , L I . 

i=l 



c. Now the MLR 100(l-a)?5 LCL for R can be 

s 

computed 

^S,L(a)=®='P 

Like the LR method, the component data order must be 
specified. 




2.41) 



2.42) 



2.43) 
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III. THE SIMULATION 



A. GENERAL METHODOLOGY 

Any lower confidence limit (LCL) procedure can be evalu- 
ated by computer simulation of its distribution as follows t 

1. Suppose it is desired to evaluate a proposed 

A 

lOO(l-a)?^ liCL procedure, denoted Rg system relia- 

bility R , Then the assertion is 

O 

A 

Equality should hold if ^3 L(a) ^ continuous random 
variable. 



2. Rg = f (R^ jRg, . . . . ,Rj^) , where R^ is the true reliabil- 
ity of the ith component. For an independent series system, 



K 

R_ = Tf Rj . If exponentiality is assumed, an equivalent 

S • 4 X 

1=1 

statement is R^ = f • • • • • 

3. Assign values to the parameters a, K, and R^^ (or 

i = 1 ,2, . . . . ,K. Simulate life testing by generating random 
component times-to-failure, and compute the resultant 

A 

^S,L(a) • 

A 

4. Generate the approximate distribution of Rg l((^) 
by repeating step 3 five hundred times. 



A A 

5 . Order the Rg realizations to get Rg »... 

A ( 1 / 



. . . , R 



S,L(a) 



(500) 
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,R> . • . 



and 



6, Find the (l-a)500"th order statistic of Rg 

denote it A^_^. Thus is the (l-a)th percentile of 

A 

the distribution of the LCL random variable L(a)* 
in fact, Rg l(^) is an exact lOO(l-a)^ LCL procedure for 
Rg, then A^_^ should be approximately eqxjal to R^, 

7. By repeating steps 3 through 6 for various sets of 

. . . . ,Nj^, Rj^jR^, . . . « ,Rjj. and a, and comparing the 

resultant A- to R_, the overall performance of the LCL 
A -Cl s 

procedure can be evaluated, 

A 

The actual confidence level given by Rg can be ob- 

tained by finding the order statistic of the generated 
distribution which matches (or closest matches) R . If 

the index of this order statistic is denoted i , then 

. ♦ ^ 

(100?^)t^ = Actiial Level of Confidence of R«, t / ^ (3.2) 

500 

Equivalently, if A, <R„» the procedure is a conservative 

i-(X 3 

one, and vice-versa. 

Figure 2 depicts a conservative outcome with A^_^ 

The degree to which A^^_^ equals R^ reflects the validity 

A 

of equation ( 3 . 1 ) and therefore the accuracy of Rg ^(a)* 
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Not only should an LCL procedure be accurate, but also 

A 

should have small standard deviation. Even though Rg 
may be an exact LCL procedure, its practical value is 
diminished if it produces widely dispersed LCL's, This 
study used both criteria for comparison of the three methods. 



B. GENERATION OF SAMPLE SIZES 



The component test data are generated in a manner some- 
what representative of data accumulated in missile flight 
tests. Suppose some number of series systems are to be 
used for testing. Failure of a component may fail the sys- 
tem, but still allow testing on components upstream of the 
failed one. For example, if the system is a five -stage 
missile, failure of the third stage may or may not allow 
testing on stages four and five. 

Input parameter N^^, the number of mission tests on the 
first component, is the number of systems to be tested. A 
component failure is assumed to preclude testing on upstream 
components one-half the time. The simulation computes the 
number of tests on the ith component as 



N 



i 




i-1 
i I 
j=l 




( 3 . 3 ) 



where "[ ]" denotes "the smallest integer greater than or 
equal to". To illustrate, let Nj^=20 and assiane the first 
component had three failures. Then the component two 
sample size becomes 



N 



2 




= 18 mission trials 
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til 



It should be understood, however, that the three procedures 
themselves do not require this scheme, but are valid for 
varying sample sizes, 

C, THE SIMULATION ALGORIT.™ 

Step one* Initilize the number of series components K, 
the niamber of systems to be tested N^, the true reliability 
of the ith component R^, i=l,2,,,.,K, and the number of 
replications desired ("Do Loop" index). 

Step two I Using the probability integral transform 
(PIT) method [Ref, 5i p. 16s], generate exponential failure 
times for the copies of the first component as shown 
below. Exponential failure data is a requirement for the 
CLG and LR methods. The LG method, being non-parametric , 
can use the same data, 

a. Generate N^ uniform (0,1) random numbers for 



component one. Denote these U 





1 



b. Let F. . = 



0 if a success occurred for compo 
nent one on trial j 



1 if component one failed on trial 



0. j=1.2 ,N^ 



Appendix. E shows 




( 3 .^) 



( 3 . 5 ) 
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c. For the 


LG method, compute 






(2Ni -3) 






■ (2Nj -2) 


(3.6) 




■ Nl-1 


(3.7) 








and F^ 


= E F, . 

3=1 


(3.8) 



d. For the CLG method, compute the test time for 
component one. 

Ni 

Tsum. = L T. . (3.9) 

^ j=l 



Step three* Compute 

2 



( 3 . 10 ) 



for the LG method, and 



A 




F 



1 



Tsum^ 



(3.11) 



for the CLG method. 

Step four* The component test times for the MLR method 
are defined differently from that of the CLG method. The 
MLR method uses only accumulated time to the last failure 
for each component; if no failures occur this is zero. 

Thus, compute for component one 



T* - T* 



if Fj^> 0 



where T^. is as defined on page 20, 



(3.12) 
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step fivei Compute the number of trials on component 



two, 




Repeat steps two, three, and four for component two. Then 
compute + F2)] . In general, the sample size 

for the ith component is 




i-1 
Z F 

j=l 



3 . 



(3.13) 



Step sixj Continue alternating through steps two 
through five for the remainder of the components. 

Step Severn Obtain 



S 



K 

Z 

i=l 



A 

T. 



( 3 . 14 ) 



A K , 

Z = Z Z. 
i=l ^ 



A ^ A , 

Var(S) = Z (T./N. ) 

i=l ^ ^ 

A ^ A 

Var(Z) = Z (Z./N.) 

i=l ^ ^ 

. AO ^ 

r = S^/Var(S) 

L = Z^/Var(Z) 

and the total number of replica failures 



(3.15) 

( 3 . 16 ) 

(3.17) 

( 3 . 18 ) 

(3.19) 



K 

FT = Z F. (3.20) 

i=l ^ 
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step eight 1 To preclude non-integer degrees of freedom, 



denote 

[2r] =max^2, smallest integer >2r|' 

[2t] = raax^2, smallest integer>2L|' 

Step nine* For the MLR procedure, compute 

if FT = 0 

otherwise, i=l,2,,,.,K 



U = I min 



and 



rain T* 



= f greatest index such that 



( 3 . 21 ) 

( 3 . 22 ) 

( 3 . 23 ) 



li * 

I T. . < U 
0=1 



K 



if F^> 0 



if F^ = 0 



(3.24) 



then obtain I = max ■< 1 , Z I . 

i=l 



( 3 . 25 ) 



The zero failure portion of the U computation sets U to 
the observed number of "system” successes (see Appendix D). 

Step teni Compute the replica one ICL's for the three 
procedures. Define RD, RT, and RL for discrimination as 
below 



a, LG method 



's,I,(a) 72 



b. CLG method 



^S,L(a) 



c, MLR method 



= RT = Sxp 



S,L(tt) = RL = Exp 




( 3 . 26 ) 



(3.27) 



( 3 . 28 ) 
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step elevem Replicate steps two through ten 500 times 
to obtain 



RD. , 


RD« 




1 ' 


2 




RT. , 


RT^ 




1 * 


2* 




RL. , 


RL^ 




1 * 






FT. , 






1 * 


2 





Step twelve I Order the LCL’s in step eleven. 

,RD, 



^( 2 ) 
RT(i), RT(2). 



,RT 



(500) 

(500) 



RL/ 



RL/ 



,RL/ 



'(!)» ""(2) ’"-^(500) 

Step thirteenj Next, compute for the three proce- 



dures. 



RD 



RT 



(500(l-a)) 

(500(l-a)) 



”^(500(1 -a)) 

and the average number of failures per replica 
^ 1 500 

Each proced\ore*s sample variance is computed by 



(3.29) 



.2 1 
^ ^ ,i=l 



(3.30) 



^^S,L(a)^0 ■ ^^S,L(a)^ 

where ^3 l((x) average LCL over the 500 replicas. 

Now each procedure’s accuracy can be determined by comparing 
A- ^ to true system reliability R , and relative dispersion 
by comparing s. 
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Reference 1, the original LG method paper, used the 



quantity 

K 

TT = L N.Q. (3.31) 

i=l ^ ^ 



as a measure of accuracy and the amount of testing necessary 
to assure sufficient accuracy of the LG procedure. As long 
as no component sample size is below ten, Table I shows 
recommended TT for the LG method (Reproduced from Ref, 1, 
p. 19). 



TABLE I 

Recommended TT for the Log-Gamma Method 



lOO(l-a)^ 


Minimum TT 


Reasonable TT 


80 


3 


k 


90 


8 


10 


95 


15 


20 



The simulation computes equation (3.29) for comparison 
with the above Table, 
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IV. THE INITIAL SIMULATION 



A. CASE DESCRIPTION 

The initial cases analyzed had true system reliabilities 
ranging from near ,70 upwards and were composed of fifteen 
or forty components. The average number of failures per 
replica, TT, ranged up to near 15. The first simulation 

A 

used the formulas for Rg page 28. The results are 

listed in Table III. Two cases were also ran v/ith a Weibull 
failure distribution, vice exponential, to test the CLG and 
MLR procedures sensitivity to the exponential assumption. 
Appendix E develops the PIT method for generating exponential 
and Weibull failure data. Table IV lists Weibull results, 

B. RESULTS AND ANALYSIS 

The LG method conformed to Reference 1 assertions in 
-that performance improved with increasing TT, although 
Ref. 1 did not generate component sample sizes in the same 
manner as this study. This should, however, have no effect 
on the results. 

Small TT, such as in cases one and three, resulted in 
conservative LG and CLG LCL’s (ie,, A. 
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TABLE II 



N 



1 



K 




R 



s 



min 

max 

TT 



s 

-^ 1 -. 

LG 

CLG 

MLR 

RLG 



NOMENCLATURE FOR SIMULATION RESULTS TABLES 

I Sample size of 1st component; analogous to the 
number of systems tested 

I Number of series connected components 

t True reliability of the ith component 

I True indeoendent series system reliability 
K 



I Minimum number of failures in one replica 

I Maximum number of failures in one replica 

j Average number of failures per replica; approx- 
imation for K 

TT= E N.Q. 
i=l ^ ^ 

A 

I Sample standard deviation of Rg l((j) 

; The 500(1 -ct)th order statistic of Rq t (^\ for 
each of the three methods * 

I The Log-Gamma method 

I The Continuous Log-Gamma method 

I The Modified Lieberman-Ross method 

I The Randomized Log-Gamma method (modification 

three only) 



For example, the case one sample size for the first 
component was N^ = 20, and the series system modeled had 
K = 15 components each with true reliability R^ = .99. True 
system reliability R^ = ,860, There were as few as zero 
(min=0) and as many as eight (max = 8) component failures 
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TABLE III 

Initial Simulation Results 
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TABLE III 
(continued) 
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over the 500 replicas of case one, with the average number 

of failures per replica being 2,9 (TT = 2.9). Comparing 

A. ^ to R_ for accuracy, the LG 80^ procedure had A- =.799 

and s=,074, whereas the MLR had Aj^_^=.851 and s=,255. 

Thus, in case one both procedures were conservative, but 

the MLR was more accurate. However, the LG procediire had 

"less than one-third the dispersion of the MLR procedure. 

Increased testing, as in cases two and foiur, not only 

improved their accuracy but showed smaller sample standard 

deviation. The same comparison holds for case five with 

case six, and case seven with case eight. Also note the 

closeness of both A. and s for the LG and CLG methods, 

1 -a 

This basically says that even though more assumptions are 
required and information is needed for the CLG method than 
the LG method, it yields no better results. 

Case three of Ref, 1 is essentially case five of Table 
nil case five is essentially case six, and case eleven is 
essentially case two (note that Ref, 1 miscomputed TT in 
cases three and five). The accuracy achieved by case five 
was not as high as that of case three, but the sample 
standard deviation was comparable. In the other two compar- 
able cases, both the accuracy and dispersion match closely. 
The MLR procedure is the most accurate of the three, 
both in low and high TT cases. The sample standard devia- 
tion, however, is three to five times that of the LG method. 
The most disturbing thing about the MLR method is that even 
with increased testing (TT), s is still high. 
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Reference 6 shov/s that the LR method is expected to 
have high dispersion above about ten observed failures 
(Figure 1, p, 22), The MLR method, even in the cases with 
ten or more failures, still has much higher dispersion 
than the LG and CLG procedures. Reference 6 attempted to 
improve the LR method by reduction of data loss. By 
ordering the failure times in increasing order, maximum data 
usage and chi square degrees of freedom were attained. The 
resultant LCL*s were found to be biased in an unpredictable 
direction (based on a single parameter) and were even more 
widely dispersed. It was therefore proposed that all possi- 
ble orderings of the data be considered, and research is 
currently being conducted in that area. Thus this study 
pursued it no further. 

The two Weibull cases showed that the CLG and MLR methods 
were slightly sensitive to the exponential assumption. 

Since T' — v exponential (>►) implies T^'^^ Weibull (g,^) (see 
Appendix E), then for &=,5 and T<1 mission unit, the gen- 
erated Weibull failure time is sooner than its exponential 
counterpart. Likewise, for 0=3# 0, the Weibyll time is 
later. In fact, case one with 0=,5 gave slightly lower 
for both methods (excepting the 80^ MLR LCL) . With 
0=3# 0, both cases gave slightly higher A^_^ (again, with 
the same exception as above). 
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V. MODIFICATIONS OF THE METHODS 



A. MODIFICATION ONEi EXACT DEGRESS OF FREEDOM AND ADJUST- 
MENT FOR ZERO FAILURES 

1 . Description 

The original LG method employed only integer de- 
grees of freedom: the initial results of Chapter IV adhered 
to this convention for all three methods. The accessibility 
of computers today makes chi square values with non-integer 
degrees of freedom readily available. Rounding up degrees 
of freedom by usage of the “smallest integer greater than 
or equal to" function can also cause nonotonicity problems 

A 

^S L(a)* ^o^^sider LG 80% LCL’s in the case where N^=20, 
and only one failure occurs. Then 



A 

S 



K=15 

i=l 



A 




A 

r 



.05 

Ap 

.■■■ sL . 
15 



- . (•Q 5 X ^ - 1 

(.05/20) “ 



(5.1) 



(5.2) 



then 2r = 2 

[2?]= 2 

thus, Rs,L(ci) ' Exp I — -|l 2 lLs_l (5_3) 

I Xi-a. [2flJ 
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A 




799 



^S,L(.2) 



Sxp 



72 

8 , 2 



Now, take the exact same case and outcome, except that in- 
stead of one failxire in one component, two failures occur 
in the same component. Then, 

s = .103 



A 

r 



(.103)^ 

■(■.1657207 



2r = 4.105 
[2r] = 5 



2.053 



It follows that, 



^S,L(.2) ■ 



-5( .103) 

^ 8.5 



.803 



The above LCL is higher even though one more failure oc- 
curred, due to rounding up degrees of freedom 2r. 

Another improvement felt necessary was an adjustment 
for the event of no failures for the LG method. The initial 
procedure here gives 

A 

S = 0 

A 

and Ro T / \ = 1.00 

Therefore, the following was incorporated > Suppose 
there are no failures in one replica with initial compo- 
nent trials. Then set the number of failures on the first 
component as = i and compute 2r as if one failure had oc- 

A 

curred (this effectively constrains 2r>2). This ad hoc and 
simplistic adjustment will produce zero-failure LCL's as a 
function of Nj^, and satisfies monotonicity requirements. 
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The simulation was again run with the adjustments 
above for certain test cases. The results are listed in 
Table VI. 

2, Observations and Analysis 

Due to the fact that the IcELR method never assumes 
non-integer degrees of freedom, it was unaffected by this 
modification. Both cases tested had slightly lower 
and sample standard deviation, s for the LG and CLG methods. 
The smaller s can be attributed to less discreteness in 
Rg lower is caused by the fact that 2n 

increases faster than 2n. By rounding up the degrees of 
freedom 2n to [2n], the initial simulation produced slightly 
higher LCL's than did modification one. 



TABLE V 

Behavior of — ^ for a= .2 

% l-a,2n 



2n 


X. 8,2n 


2n 


72 

A-.8,2n 


2 


.446 


4,48 


3 


1.01 


2.97 


5 


2.3^ 


2.14 


10 


6.18 


1.62 


30 


23.4 


1.28 
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While this modification slightly decreased disper- 
sion, it did not improve the accuracy of the LG and CLG 
methods (and had no effect on the MLR method). The only 
real gain was to solve an infrequent monotonicity problem. 

If only integer degrees of freedom are available, it is 
recommended that a more refined scheme of rounding non- 
integer outcomes be devised. For instance, in the earlier 
example, 2r= 4,105 should be rounded down to 4 vice up to 
5, The LG LCL becomes ,779» which is lower than the one- 
failure ,799 outcome, but still higher than the ,738 three 
failure outcome (see Table VII), 

Being that the CLG method performs no better than 
the LG method, but requires more assumptions and informa- 
tion, no further effort was expended on it. All subsequent 
modifications are directed towards improving the accuracy 
of the LG method while maintaining small dispersion, 

B, MODIFICATION TWO 

1 , An Accuracy Improvement, and an Adjustment for the 
Degrees of Freedom in the 90^ Lower Confidence 
Limit Procedure 

The primary weakness of the LG method is its poor 
performance when few failures occur. More testing, and 
thereby more failures, results in a more accurate • 

Table VII lists and plots possible LG LCL’s for zero through 
ten failures when = 20, Note the gaps caused by discrete- 
ness up to one failure. Also note that the 90 % LCL for two 
and three failures is higher than that for one failure. 



42 










fit 

1 



fP-n 



o 



o 



o 



o 



o 



M 

PQ ^ 

<< 7 

£-1 - 



_t® — O — u*. — — 

U J T «C ® CO — 'JN 

•^r^O'O'CCJ^iTir'r'J’*^ 



OCODOOCOCOOO 



o* 

o - 



— CT'w-0'MC'00>C 

T- _;r'>'^'^7“'rc:c-v’®-'' 

o>* 



»o 13 c“ c c' -5 CO o :? 



o 

UJ i or 

O C. . , > 

< ^\ -* 

o rt - 

® Z' It 

Z » <r_jU'^'0 ® syr~ 1UUV ><— ^ 

S -r .O'iJ C'' MCt'' -- 

< LLjoccor'C'^','*C'Oc 

O ,.... vr 

Q. *sj eg -X. O —I run O' c 



o 



o-J: 

'MV 



OV «• ■» * -Jr V •! 



.f 

■ir •^ V ♦ V •« 



. r- -fr -• ♦ V V ■( 



k 



.4 >X « VV {. «. 



loo-^M'^-rmxT^xo’^c^ 



43 



< >< #< i4<> < • / *< (•>«» < ♦ >*<-v'»«<< t <•♦«<■>> >♦< «« 

0.0 10. OC 







4 

. I 



^ i 



I 



. ^ 



>r 

O) 



CD 






>0 



C“?''T5*^'OCC ClO'M— < 

' c■ocr''J‘Ocoor^^OJ^ 

— ^rlr>7'C^C*‘^t^C^c^t^GC 












<»- *= 
u. o cjO’^>oXsr'^OvM'\>— 
^ o O' -3 r» c U-» -V 
— a'Co;>C“7'c-c r'-'rx 

Z 

O <Ni 'Nj-niri .in 



o« 

o* 



o*- 
in * 



Mi 

> Z 

a: 

m? 
< = 
Eh.:; 



— iTV — — 

x\ O J' C X 33 ^ 

-J ''J C-O 'M 

►'■'z5**-oc.3u'Nu‘'r'>r>Tr' 

. . . 

C'OOOOOOOCC'^O 



I 



0-J*^'^i/**v;0'C 'TiT' 

C.O — ‘T'C^r'-'cC'co 

C-CC rviT *r 'T- 

. . . 

r; o o o o r: o o o o -t: o 



O'v- r; V 









r\i — 

n 

« u. 



f 



44 






This non-mono tonicity is caused by the sharp drop-off in 

degrees of freedom. As an adjustment, 

2r for 90?^ LG LCL's was constrained to be at least 2,5? 
the minimum 2r for 80 % LCL*s remains 2,0, The results can 
be seen in Table VIII, 

Consider the classical binomial component LCL pro- 
cedure on the probability of mission success p. If p is 
estimated by p = X/N where X is the observed number of 
successes in N trials, then a lOO(l-a)^ LCL on p, denoted 
^L(a)’ solution for p in the equation 

S (”)pj(l- p)”-^ = a (5.*^) 

j=x ^ 

Under the simulation of Chapter III, if is the component 
one sample size and no failures occur in a replica, it can 
be equivalently stated that "systems" were tested with- 
out failure. Likewise, one component failure implies ex- 
actly one system failure. However, when two or more 
different types of components fail, it cannot be ascertained 
how many system failures occurred. Figure 3 illustrates 
this for the two-failxire case. 



Figure 3 



Component Failures Versus System Failures 



Component 



1 2 



K 



1 2 



N, systems k k 
tested with 
one system 7 
failure I 



systems x 
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Treating a "system" as a component, equation (5.^) 

A 

can be used to calculate Rg when zero or one failures 

occur. 



a. Zero failures i 

For X=N successes, Modifica- 

tion two revised this upwards to 

«S,L(a)= (5.5) 

b. One failure I 

Equation (5.^) was applied directly for X=N3^-1, 

A 

That is, Rg is the solution for p in the equation 

^ . (5.6) 



or 



N^p^i“^(l-p) + p^i = a 



(5.7) 



c. Two through eight failures: 

The LG method was adjusted upwards as follows: 



"s.Ua) =* 



'*S,L(a)<«l'^>-^"s,L(a)'fl-^-l> 



(5.8) 



where Rg l((j)(^i»^) denotes the LG LCL computed with the 
observed total replica failures FT when the original sample 
size is N^, 



d. More than eight failures: 

The original LG procedure is used with exact 
degrees of freedom. The results are in Table IX, 
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TABLE IX 

Modification Two of the Log-Gamma Method 
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2. Observations and Analysis 



Modification two did improve the accuracy of the 
LG method, while slightly increasing dispersion. The 90?5 
procedure was noticeably improved by the degrees of free- 
dom constraint, although still conservative. There is, 

A 

however, still too much discreteness in values of Re, , / \ 

b,Ma; 

when few failures occur. Table X generated at NPS by APL 
subroutine **Histlist" (see documentation), illustrates this 
for case five. This discreteness usxaally causes the proce- 
dure to yield more than the target 1 -a confidence, and is 
a problem with nearly any method using only attributes data. 

This being the case, the next logical step was to 
fit a continuous curve to the procedure by randomization, 

C. MODIFICATION THREEi RANDOMIZATION 

1 , Randomization of the Log-Gamma Method 

Many LCL procedures which use only attributes data 
are degraded in that they yield conservative bounds. Be- 
cause only a finite set of outcomes can be observed for any 
test plan, then only a finite set of LCL's can be realized, 

A 

Thus, ^3 is a discrete random variable which ideally 

gives the LCL closest to but not greater than the "exact" 

LCL. 

The 1975 article of Barr and Jayachandran fPef. 7» 
p. 67 - 68 ] developed an exact, randomized binomial component 
LCL procedure. The same rationale used before (see Figure 3) 
allows the randomized binomial procedure to be used for 
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TABLE X 

Case 5 Log-Gamma 80 Percent LCL’s with Modification Two 



SERIAL NUMBER 


ORDERED DATA 


OCCURENCES 


PERCENT 


1 


.407610 


1 


.002 


2 


,444490 


1 


.002 


3 


.444960 


1 


.002 


4 


.471830 


1 


.002 


5 


.475840 


2 


.004 


7 


.477390 


3 


.006 


10 


.482700 


2 


.004 


12 


.484660 


1 


.002 


13 


.487430 


1 


.002 


14 


.527610 


1 


.002 


15 


.534450 


3 


.006 


18 


.538120 


10 * 


.020 


28 


.538550 


1 


.002 


29 


.540650 


1 


.002 


30 


.541090 


1 


. 002 


31 


.542420 


2 


.004 


33 


.542860 


1 


.002 


34 


.571020 


11 * 


.022 


45 


.576210 


1 


.002 


46 


.577770 


7 * 


.014 


53 


.578300 


2 


.004 


55 


.580530 


10 * 


.020 


65 


.581070 


1 


.002 


66 


.583950 


1 


.002 


67 


.584260 


2 


.004 


69 


.584910 


2 


.004 


71 


. 616160 


13 ** 


.026 


84 


.620600 


5 * 


.010 


89 


.622570 


14 ** 


.028 


103 


.623270 


1 


.002 


104 


.624390 


24 *** 


.048 


128 


.625090 


2 


.004 


130 


.627950 


1 


.002 


131 


.628010 


1 


.002 


132 


.628080 


1 


.002 


133 


.662770 


23 *** 


.045 


156 


.666380 


1 


.002 


157 


. 666490 


14 ** 


.028 


171 


.667840 


1 


.002 


172 


.668570 


16 ** 


.032 
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TABLE X 
(continued) 



SERIAL NUMBER ORDERED DATA OCCURENCES PERCENT 



188 


.669380 


21 


*** 


.042 


209 


.669530 


1 




.002 


210 


.670340 


6 


* 


.012 


216 


.671090 


2 




.004 


218 


.672070 


1 




.002 


219 


.673220 


1 




.002 


220 


.710230 


37 




.074 


257 


.713320 


22 


*** 


.044 


279 


.714870 


25 




.050 


304 


.715380 


6 


♦ 


.012 


310 


.716280 


2 




.004 


312 


.756600 


47 




.094 


359 


.758850 


21 




.042 


380 


.759200 


21 


*** 


.042 


401 


.761320 


2 




.004 


403 


.789380 


39 


***** 


.078 


442 


.791340 


27 


*** 


.054 


469 


.890140 


21 


*** 


.042 


490 


.938140 


11 


* 


.022 
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"system" LCL's when zero or one failure occurs. Equations 
for the Randomized Log-Gamma method (RLG) are derived in 
Appendix F, An example is given in Appendix G, 
a. Randomized Log-Gamma Procedure 

(1) If zero failures occur, generate a uniform 
(0,1) random number Y, Then 



^S,L(a) 




^1/Nl 



if Y <1 - a 



(5.9) 



^ 1.0 ifY>l-a 

(2) When one failure is observed, generate a 

A 

uniform (0,1) random number Y, Then Rg solu- 

tion for p in the equation 

(1 - Y)N^p^l~^(l - p) + p^l = a ifY<l-a (5.10) 



^S,L(a)' 



This solution can be approximated by 

(5.11) 

for Y> 1-a (see Appendix P), 

(3) Two through four failures inclusive* 

Generate a uniform (0,1) random number Y^ 

for each component that had at least one failure, i=l,2,... 

■* 

• . . ,K, Then use the LG method with instead of 

F^. Thus, the RLG formulas become 

2N^-3 



“^i " ■ 2N, - 2 



®i =-n7^ 



(5.12) 

(5.13) 
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(5.14) 



A 




s 



A 




(5.15) 



r 




= — s : „ . 

K T. 



(5.16) 



A 



(5.17) 



and 



R. 



The only differences between the original LG formulas and 
those above is the computation of in equation (5.14), 
and usage of exact degrees of freedom. 

(4) Five or more failures j 

Use the non-randomized LG method with ex- 
act degrees of freedom. That is, use the formulas in (3) 



above except use vice in the computation of T^, 

2. Modification Three Cases 



three was expanded greatly. Cases one through twelve have 
an of either 20 or 50 » and cover the range of pertinent 
system reliability R , All twelve cases were first ran 
with the number of components K=15i and then reran with 
K=40, Cases with equal component reliabilities were also 
ran with K=4, The system sample size was reduced to ten, 
and the applicable twelve cases ran again, with K = 15» 40, 
and 4, Modification three results are listed in Table XI 



A 



The number of cases simulated under modification 
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for K = 15, Table XII for K = 40, and Table XIII for K = 4. 

Table XIV lists results of cases from Ref, 1, which had 
highly-varied component sample sizes, 

3, Results, Analysis, and Conclusions 

All three method results were tabled for comparison 
under modification three, although randomization of the LG 
method was the only change. 

The accuracy of the RLG was comparable to that of 
the MLR, while having much lower sample standard deviations. 
Both the RLG and CLG methods had dispersion inversely pro- 
portional to sample size, while the MLR continued to con- 
sistantly have high dispersion regardless of the circumstances. 
The most significant improvement in the RLG was its 
performance with few failures and less testing. Especially 
in the K = 4 and K=15 cases with small TT, the RLG was near 
exact while the CLG sometimes gave of 1,00 (meaning 

at least the upper (100)a?S of the simulated distribution 
was LCL*s of 1,00), The MLR procedure was inaccurate for 
very high reliability systems, such as case 11 with K = 15, 
due to the upper limit of its possible LCL values. In 
case 11, with = 20, the maximum MLR LCL is ,923 with zero 
failures (see Appendix D), whereas true system reliability 
is ,956, As in the earlier LG results, the 90% RLG procedure 
was usually less acciirate, less stable and slightly more 
dispersed. The presence of one component with dissimilar 
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reliability, like case seven with K = 15 seemed to degrade 
accioracy somewhat. Additional testing, however, as in case 
eight, dampens this out. 

Cases one and two of the original LG paper [Ref, ij 
were also simulated with modification three to check sensi- 
tivity to mixed sample sizes (see Table XIV), Note that 
randomization was rarely necessary in case two (min =2), 
and never in case one (min =5). The accuracy of all three 
methods was high due to the large amount of testing. Note 
the small sample size of the twelth component in case one. 
This seemingly had little effect on the RLG method's accura- 
cy, although s is suspiciously large when compared to case 
two. When R ^2 the effect on the RLG became 

clearer. When a component twelve failure occurred, its 

A ^ A 

contribution to S and r so dominates that Rg x,(a) nearly 
halved from what it would have been otherwise, 

A 

Figures 4 and 5 give histograms for Rg ol" the 

RLG procedure generated under cases one and two respectively. 
Both have skewness and kurtosis roughly comparable to a nor- 
mal distribution, and both have medians near-equal to their 
medians (symmetric). Figure 5 (case two with N^^ = 50) has 

A 

a lower maximum Rg ^(a) ^ higher minimum than Figure 4 

(case one with N^ = 20), reflecting the decreased dispersion 
of the RLG procedure with increased testing. 
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APPENDIX A 



APPROXIMATION OF S 3 Y A TAYLOR SERIES 
The Taylor series approximation of f(x) about x=a 
can be stated asi 



f(x) = f(a) f *(a)(x-a) -»■ — ->• 



+ f^(a)(x - a)^ 



(A.l) 



Here, f(x) = -ln(x), where x=(l-Qj|_), Let a = l. 
Then (x - a) - -Q . 



f(a) = 0 
f '(x) =- 



l.Qi • 



f'(a) = -1 



f"(x) = 



(1 -Qi) 



f"'(x) = 



-2 






— , f"(a)=l 



f'(a) = -2 



Equation (A.l) becomes i 



f{x) = 0+ f ( ■■■ ?>( +... 



4 A 



qO 

= “f 

0=1 J 

K 






K Q 

Thus, S = £ -ln(l-Q.) =5; L “f 

i=l ^ i=l 0=1 ^ 

Dropping terms of order three and higher. 



K r 
S « L 
i=l 



^i"T 



(A. 2 ) 
(A. 3 ) 



(A. 4 ) 
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APPENDIX B 



AN UNBIASED ESTIMATOR FOR T^ 

Qf 

Let ~ unbiased estimator T^ is desired 

for T^, which is of the form 

A A ® ; A o 

Ti = A^Q^ + T^i (B.l) 

A F. 

where number of failures of ith component F^ 

is a binomial (N = N^, p = Qj^) random variable with mean N^Q^ 
and variance N^Q^(l-Q^), Thus, 



E(Q^) 


= 4 = «i 


(3.2) 


Var(Q^) 


Qi ( 1 “ Qi ) 
= \ Var(F. ) = \ ^ 

N^ ^ ‘ 1 


(B.3) 


E(Q?) 


= Var(Q^) > (E(Q^))^ 


(3.4) 



Qi(l-Qi) 2 

—i 1 + Qf 

N. 1 



«i-Qf * N^Q? 



N, 



Substituting 



B • A ■ 



E(T^) = A^E(Q^) 4- -^E(Q|) 



B. B. Qf 

= ^^i 2rr>^i ^®i-N7)-F 



That T^ is unbiased implies 

( 

E(T^) = 



Q? 



(B.5) 



(3.6) 
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Equating coefficients with equation (B.5) 



®i 

^i 2N^ ^ 



®i 

®i ’ n7 = ^ 



(B.7) 



(B.8) 



Solving the above two equations simultaneously gives the 
desired expressions for and B^ 



2Ni - 3 

^i " 2N^ - 2 

N. 



®i "" N. - 1 



(3.9) 



(B.IO) 
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APPENDIX C 



DERIVATION OF THE ACTUAL VARIANCE OF T. 

K T- ^ 

AND COMPARISON WITH Z 

"'i 

Reference 1 used as a variance estiiaate for T.. 
Then for the method of moments gamma fit, 



. K ^ K T. 

Var(S) = Z Var(T , ) ^ L ^ 
i=l ^ i=l ^i 



(C.l) 



The following is a derivation of the actual variance 



of T^, and then a comparison with the above estimator. 

B. 

Since T, = A,Q. + (C.2) 



A A i A O 

Ti = A^Q^ + 

2 , '' 



then Var(T^) = A^Var(Qj_) + Aj^B^C0V(Q^,Q^) + -^Var(Q^) (C.3) 

A F- 

where Q. = ~, The total number of failures on the ith 
1 

component F^, is a binomial (N = N^, p = Q^) random variable, 
Then ^ . 

E(Q^) = |f7E(Pi) = Qi (C.4) 

A 1 Q. (1 - Q. ) 

Var(Q.) = ~ Var(F.) = ^ ^ (C.5) 

1 N^ 1 

E(Q^) = Var(Q^) -f (E(Q^))^ 



B? 



Qj-Qf 

^i 






(C.6) 



and C0 V(Q^,q2) = e(Q^) -E(Q^)E(Q^) 



(C.7) 
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:r 




-^0 




j ‘ * to* ' 







To solve eqxiation (C,7)» E(Q?) = must be solved, 

^ Nr ^ 



Model ^ ^ 

0 

Ni 

and let F, = El 
m=i 



if the test fails 

if the test does not fail 



3 _ 






Then ?i = \ Z I 
,m=l 



m. 



^ ^ ^ I I I 
j k 1 ^k ^1 



(C.8) 



(C.9) 



and 



E(P?) = E(I^) + Ed^)E(Ij^) + 

(all three equal) (two the same and 

one distinct) 

(all three distinct) 

= 3N.(N^ - 1)Q^ + N^(N^ - 1)(N^ - 2)Q? 



This implies E(Q?) = ~r E(F?) 

^ N^ ^ 



N? ^ 
1 



Qi + 3(N^-1)Q? -*• (N^-1)(N^-2)Q^ 



Now, using equation (C,7), 



C0V(Q^.q 2) (2N^-3)Qi-2(N^-l)Q?| 



(C.ll) 



t <^2 



All that remains unknown in equation (C.3) is Var(Qf). 
Var(Q?) = E(Q^) - (E(Q?))^ 



2 

Q; - Q7 






(C.12) 
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4 

*' I 






Using the same model as before, 



E(F^) = ♦ ] I E(i2) ♦ = I E(i3)E(I^) 

(all indexes (indexes equal (three indexes the 

equal) in pairs) same and one distinct) 

♦ 3 Ed^)E(I^) 

(two indexes the same and two distinct) 

* 3 k ? L =<I3> 

(all four indexes distinct) 

= 3N^(N^ - DQ?-^ 4N^(N^ - 1)Q^-»- 6N^(N^ - 1)(N^ - 2)Q? 

N^(N^ - 1)(N^ - 2)(N^ - 3)Qi 



Equation (C.13) is used to find 



E(Q^) = 4r Q. + 7(N. - 1)Q?+ 6(N. - 1) (N. - 2)Q? 

^ J- i -L J- ± ± 



N: 



-► (N^ - 1)(N^ - 2)(N^ - 3)Q^ 



(C.14) 



Substituting eqiiation (C,l4) into equation (C.12), 



Var(Q?) = -i J 1+ (6N^ - 7)Qi'>' 4(N^ - D(N^ - 3)Qf 

I 



- 2(N^ - 1)(2N^ - 3)QJ 



(C.15) 



The final result can now be obtained by substituting equa- 
tions (C.15), (C.ll), and (C.5) into equation (C.3)» yielding 
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a2 

A 



Q. r 



Var(T, ) =i 7 ^(Q, -Q?) + A,B,^ 1+ (2N^ - 3 )Q^ - 2(N^ - 1)Q? 



•i' ''i' ,_ 



B? Q • 

^ ^^^l^(6Ni-7)Qi^ 



4(N^ - 1)(N^ - 3) 






- 2(N^-1)(2N^-3)Q^ 



(C.16) 



The cumbersome expression above can be greatly simplified 



by dropping terms with divisors of N? and higher, yielding 



^ Q. r 

Var(T. ) S! ^ I (1 - 8, )(A, + B.Q, 






1 1 



(C.17) 



Then 



A r~ ^ ^ 

Var(T, ) I (1 -Q, )(A, + B,Q, )‘^J where Q, = ~ (C.l 



, 

1 L 



11 



/N /s 



■i 



8) 



A comparison was made between Var(T^) as given by equation 
(C,l8), and that used by Ref, 1, The results are listed 
for = 10, 20, and 50 in Table XV, The simplistic esti- 



A 

K T, 



mator L ^ turns out to be an excellent approximation 
i=l^i 



for Var(^) 



Z Var(T. ), 
i=l ^ 



73 



% 




If 

x<i 



V 














TABLE XV 

A 

Actual Variance of Compared to Estimate 
(One Failure Per Component) 



FAILURES 


/s K Ti 

Var(S)=,s; jji 
1=1 1 


Var(S)= Z ^(1 -Q.)(A.+B.Q,)^ 
i=l^^i ^ 111 


1 


N ^=10 


,01000 


,01003 




20 


,00250 


.00250 




50 


,00040 


. 00040 


2 


N.=10 


.02235 


.02242 




20 


.00527 


.00527 




50 


.00082 


.00082 


3 


N.=10 


. 03469 


.03480 




20 


, 00804 


.00805 




50 


,00123 


.00123 


4 


N^=10 


.05032 


.05050 




20 


.01113 


.01113 • 




50 


.00167 


.00167 


5 


it 

O 


. 06594 


.06619 




20 


.01421 


.01422 




50 


.00210 


.00210 


6 


N-=10 


.08635 


.08672 




20 


.01767 


.01769 




50 


.00255 


.00255 


7 


Ni=10 


,10676 


.10725 




20 


.02113 


.02115 




50 


.00301 


.00301 


8 


N.=10 


.13454 


.13526 




20 


. 02504 


.02506 




50 


. 00348 


. 00348 


9 


N.=10 


.16231 


.16327 




20 


.02895 


.02897 




50 


.00395 


.00395 


10 


N^=10 


.20231 


.20377 




20 


.03339 


.03342 




50 


. 00445 


. 00445 
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APPENDIX D 



DERIVATION OF THE ZERO FAILURE CASE 
FOR THE MODIFIED LIEBERMAN-ROSS METHOD 



The variables U and I are undefined when no failxnres 
occur. Consider type III censoring in which N components 
are placed on simultaneous test, with replacement, until a 



is a component LCL procedure, and not a system LCL procedure. 
Now, consider the Modified Lieberman-Ross (MLR) procedure 
where N^ items of the ith component have been tested with no 
failures, i=l,2,...,K. If the N^ are identical (as is the 
case in this study for zero failures), then the above is 
equivalent to testing N^ "systems” with no failures until 
Tq = 1 "system" mission. 

The type III lOO(l-a)^ LCL on the mission probability of 
success p of a component is 



where F is the observed number of failures, N is the niimber 
of components on simultaneous test, and Tq is the preselect- 
ed test time. Then for F = 0, 2F+2 = 2 and 

2NT^ = 2N. • 1 system mission unit = 2N. 

0 1 '' 1 

A lOO(l-a)?J LCL on system reliability R when no failures 

s 



for Nj^ eqml, i=l,2,,..,K. If the N^ are not equal, the 
minimum N^ should be used. 



pre-selected time Tq [Ref. 8, p. 23S] . Type III censoring 




(D.l) 



occur is 




(D.2) 
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APPENDIX E 



USE OF THE PROBABILITY INTEGRAL TRANSFORM (PIT) IN 
GENERATING EXPONENTIAL AND WEIBULL FAILURE DATA 



Assume an exponential failure process for the ith com- 
ponent with rate per mission unit. Then the reliability 
of the ith component for completing one mission unit isj 

R^(l) = Exp(-X^ .1) • (F.l) 

Utilizing the PIT method, draw a uniform (0,1) random num- 
ber, denoted ”U", and form the equality: 

U = Exp (-Xj^t) (F.2) 

Solving for tirae-to-failure t 



ln(U) = -X.t 

a. 

It follows that: 

+ - -ln(U) 

^ " X. 

1 



(F.3) 



(F.4) 



The computer program uses the following algorithm: 

1) Generate a uniform (0,1) random variable 

2) If U = Exp(-X^t) is less than Exp(-X^* 1), then t>l 
mission unit, and a success has occurred. Truncate the 
time-on-test for that component trial to 1, 

3) Otherwise, a failure has occurred at t = ^ 

^i 

The simulation was also ran under a Weibull failure 
process for sensitivity analysis. The Weibull (P,X) densi- 
ty function is f^(t) = Exp(-it® ) (F.5) 

and hazard function 

h(t) = pXt^‘^ 



t > 0,X > 0,P > 0 



(F.6) 
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Using the PIT method as hefore, draw a uniform (0,1) 



random number U and set 

U = F(t) 



= Exp(-X^t^) 

thus T = 

‘'i 



(F.7) 

(F.8) 



Comparing equations (F,4) and (F.8) shows that if 

is an exponential (X.) component failtire time, 

^i ^ 

then is Weibull O, X^), Thus, to perform the Weibull 

sensitivity analysis, only the above change needs to be 
made to the simulation algorithm (Chapter III). 

Taking the derivative of the Weibull hazard function 
with respect to time 

- d , ( . h( . tl) ■ = x^O^-0)t^"^ (P.9) 

Therefore, any 0<&<1 yields a decreasing hazard rate, and 
any P>1 gives an increasing one. Case one was ran with 
P = .5 and J,0, Note that the comparison logic, used by 
the simulation algorithm to determine if a failure has 
occurred, reduces to the original expression. The number 
of failures is then the same as before. The Weibull results 
are shown in Table IV. 
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APPENDIX F 



DERIVATION OF THE RANDOMIZED LOG-GAMMA METHOD 
The technique for randomization of the classical bi- 
nomial model is a direct application of Barr and Jayachand- 
ran's 1975 article [^Ref, 7 ^ . It can be applied directly 
to obtain a system reliability LCL when a total of zero 
or one failure occurs among all component tests, because 
these cases translate into equivalent system failures (see 
Figure 3» p. ^5). 

The binomial point estimate for p is p = X/N, where X is 
the number of observed successes in N trials. The classi- 
cal binomial lOO(l-a)?^ LCL for p, denoted PL(a)» 
solution for p in the equation 

^ (l) U = a (F.l) 

j=X J 

when no failures occur, or X = N, this becomes 
PL(a) = 

and for one failure, P^^a) is the solution for p in 

Np^’^(l -p) + p^ = a (F.3) 

This has the property that ^^[pL(a) — ^ >l-a 

Reference 7 develops a method of randomizing discrete 
LCL procedures which are conservative, and illustrates it 
for the binomial case. The exact randomized 100(1 -a)^ 
binomial LCL for p is developed as follows. 
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a» The number of observed successes X is a binomial 
random variable with probability mass function 3(x;N,p). 
Define h(p) as the smallest integer such that ' 

Pr(X>h(p))<a X (P.4) 

Thus, h(p) denotes an observed value of X, 
b. Define 

Up = Pr(X> h(p) ) (F.5) 

and y(p) E F“^|l - (a - ap)/B(h(p) ;N,p)| (P.6) 

where F is the "randomizing” distribution function of Y. 
Reference 7 shows that F can be the uniform (0,1) distribu- 
tion function without loss of generality. Then using 
equation (F.5), y(p) can be simplified to 

y(p) = 1 - (a-Pr(X>h(p))/Pr(X=h(p)) (F.7) 

Finally, define 



L (x-^y) = 



g(p) = h(p) + y(p) (F.8) 

* 

Then the exact binomial randomized LCL for p, L (x+ y) 
is given by ^ 

^“^(x+y)} 1 - a < X'»‘y < N+l-a 

0 ; x+y<l-a 

1,0 j x+y>N-»-l-a 

To solve for L*(x+y), form the equality 

g(p) = X-^ Y = h(p) y(p) (F.IO) 



Since h(p) is an observed value of X, this reduces to 

Y = y(p) =1 - (a-Pr(X>h(p)))/Pr(X = h(p)) (F.H) 
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• tflt ^ 



-/# . 
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4 

^'P»/j 

4 




* 1 ' 




L (x>y) = 



By solving for p and applying eqioation (F.9) 

r 

the solution for p in 

(1 - Y)Pr(X=x) + Pr(X>x) = a 1-a <x+y <N+l-a 
0 x>y < 1 -a 

1.0 x+y>N+l-a 

♦/ \ 

Thus, for no failures, or X = N, L (x+y) is the solution 
for p in 



(F.12) 





(1 - Y)p^ = a 




(F.13) 


or 


li 


r a xl/N 

(1 - Y^ 


y < 1 - a 








1.0 


y > 1 - a 


(F.14) 



when X = N-1, or one failure, L (x+y) is the solution for 
p in 

(1 - Y) Pr(X =x) Pr(X>x) = a 

(F.15) 



or 



(1 - Y) Np^“^ (1 - p) + p^ = a 



When two or more failxires occur, a component LCL pro- 
cedure such as L (x+ y) cannot be used. The original Log- 
Gamma procedure can, however, be "randomized" as follows. 
Draw a uniform (0,1) random mamber for each type of compo- 
nent that fails. Denote it Y^ for the ith component, and 
compute the "randomized" number of failures 

F* = Fi - Y^ (F.16) 

where F^ is the observed number of failures on the ith 
component. 
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The Randomized Log-Gamma procedure (RLG) was developed 
by trial and error via computer simulation, using the above 



adjustments where most effective. It can be stated as 
follows! 

Randomized Log-Gamma Method 

a. Zero failures in all components! 



A 

R 



S,L(a) = 






1-Y 

1.0 



1/Ni 



y < 1 - a 
y > 1 - a 



(F.17) 



where uniform (0,1), 

b. One failure among all components! 

^ the solution for p in 



S,L(a) 



(1 -Y)N^p^l“^(l -p)-*-p^^ = 



(F.18) 



The use of a^'^^1 as an approximation to Rg 1-a, 

is reasonably accurate for low and very accurate for 
large as shown below. 



TABLE XVI 

Accuracy of the Approximation a 



1/Ni 



Y= ,9 
a = . 2 



Actual Rs^L(a) 

a'/Ni 



N = 10 20 50 

.837 .915 .965 

.851 .923 .968 



c. Two through four component failures! 

For each different type of component that had at 
least one failure, draw a uniform (0,1) random number. 
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&u:^oX 







(F.19) 



Denote it for the ith component, and compute 




Compute Log-Gamma method with exact degrees of freedom and 
instead of the observed number of failures F^, 
d. Five or more failures* 

Use the Log-Gamma method with exact degrees of 



freedom. 
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APPENDIX G 



AN EXAMPLE OF THE RANDOMIZED LOG -GAMMA PRXEDURE 
Let Nj^ = 20, K = 15i and a=,2. Suppose that the replica 
has no failures. Then a uniform (0,1) random number Y is 
generated; say Y = ,5. Then since Y < 1 - a, 

«S.L(.2) = =-955 

as opposed to the classical binomial LCL of .923. 

Suppose some future replica had one failure in some 

A 

component, and Y= ,6 is generated. Then Rg 
solution for p in the equation 

20p^9(i . p)(i . ,6) + p20 ^ 

A 

Therefore, R3 2) ~ »^92, The classical binomial LCL is 

. 858 . 



Now, suppose another replica had two failures in the 

5th component and one failure in the 15th component, and 

. * 

that Y^ = ,3 and were generated. Thus, F^ = 1.7 and 

* 

Fj^^ = ,2, Applying the LG procedure, N^ = 20, N^^^ = I9 

A i 5 A A, A 

S = L T. = T. + T. . = .0969 

i=l ^ ^ 



1=1 1 



_ „C , P9.6 9)^ = 1 926 

. 0049 



2r = 3.853 



X!8,3. 



853 



« 1.56 
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Then 



without 



^S,L(.2) 




/V ^ 

-2rS 



T,S,3*S53 



787 



randomization, the LCL would have been 



^S,L(.2) 



.740 
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APPENDIX H 



THE COMPUTER PROGRAM 

The following pages list the computer program used for 
the simulations. Flags were used to designate the portions 
of the program to he executed, depending on which modifica- 
tions were desired. Proprietary subroutines [Ref, 9 ] were 
utilized for inverse chi square values (MIXJHI), sorting 
the approximate distributions of Rg l(c[)» (^SORTA), gener- 
ation of uniform (0,1) variates (GGUB), and solving for 
the RLG procedure (ZREAL2), The APL subroutines HISTLIST 
and HIST were used in Table X and Figures 4 and 5 respec- 
tively [Pef, loj , The plotting subroutine PLOTP was used 
in Tables VII and VIII [Pef, ll] , 

The program was written in the FORTRAN IV language for 
use on the IBM-36O system at the Naval Postgraduate School, 
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